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ON THE HIERARCHICAL OPTIMAL CONTROL OF A CHAIN OF 
DISTRIBUTED SYSTEMS * 

GETACHEW K. BEFEKADUt AND EDUARDO L. PASILIAO* 


Abstract. In this paper, we consider a chain of distributed systems governed by a degenerate parabolic equation, 
which satisfies a weak Hdrmander type condition, with a control distributed over an open subdomain. In particular, 
we consider two objectives that we would like to accomplish. The first one being of a controllability type that 
consists of guaranteeing the terminal state to reach a target set starting from an initial condition; while the second 
one is keeping the state trajectory of the overall system close to a given reference trajectory on a finite, compact 
time intervals. We introduce the following framework. First, we partition the control subdomain into two disjoint 
open subdomains that are compatible with the strategy subspaces of the leader and that of follower, respectively. 
Then, using the notion of Stackelberg’s optimization (which is a hierarchical optimization framework), we provide 
a new result on the existence of optimal strategies for such an optimization problem - where the follower (which 
corresponds to the second criterion) is required to respond optimally, in the sense of best-response correspondence 
to the strategy of the leader (that is associated to the controllability-type criterion) so as to achieve the overall 
objectives. Finally, we remark on the implication of our result in assessing the influence of the reachable target set 
on the optimal strategy of XhQ follower in relation to the direction of leader-follower and follower-leader information 
flows. 


Key words. Degenerate parabolic equations, distributed systems, hierarchical systems, Stackelberg’s optimiza¬ 
tion. 
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I. Introduction. In this paper, we consider the following distributed system, which is 
formed by a chain of n subsystems (where n > 2), with a random perturbation that enters 
in the hrst subsystem and is then subsequently transmitted to other subsystems (see Fig¬ 
ure [T]T]i 


II 


dt + a(t,xl,... ,Xf)dW{t) 

dx^ = /a 


dt 

dxt = h 

U ™2 

dt 


( 1 . 1 ) 


dec” =/„(f,x" 0<t<T 

where 


• ec* is an K'^-valued state for the jth subsystem, with i G {1,2,..., n}, 

• the functions /i: (0,oo) x —>• and fji (0, oo) x for 

j = 2,..., n, are uniformly Lipschitz, with bounded hrst derivatives, 

• (T: [0, oo) X —>■ is Lipschitz with the least eigenvalue of a a'^ uniformly 

bounded away from zero, i.e.. 




> Xld, V(xl,... ,x’^) 


rjTid 


yt > 0 , 
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for some A > 0, 

• W (with Wifi) = 0) is an m-dimensional standard Wiener process. 

Remark 1 . Note that such a distributed system has been discussed in various applications 
(e.g., see (0/ and and the references therein). For example, when n = 2, the 
equation in can be used to describe stochastic Hamiltonian systems (e.g., see or 
4761/ for additional discussions). 



u 


\ 


\ 


S\ ■ dxl = .,Xt)dt + a(t,xl,.. .,Xt)dW, 

Sj ■■ dxl = ffit,xi~^,...,Xt)dt, j = 2,...n, 
u is a control distributed over an open subdomain, 

^ 1 , ^ 2 , • • •, •^n are information for interconnecting subsystems 

Fig. 1.1: A chain of distributed systems with random perturbations 

Let us introduce the following notation that will be useful later. We use bold face letters 
to denote variables in for instance, 0 stands for a zero in (i.e., 0 G R"'^) and, 
for any t > 0, the solution , Xj,..., x") to ( |l.l| l is denoted by X(. Moreover, for 
(t, {x ^~^,..., x”)) G (0, oo)xR("“'^+^)‘^, j = 2,..., n, the functionx^ i-A fj{t,x ^~^,..., x") 
is continuously differentiable with respect to x^ and its derivative denoted by (i, x-^”^,..., x”) i-A 
7A^,/,(i,X'?-\...,x"). 

Then, we can rewrite the distributed system in O' as 

dxt = F{t,xt)dt + Ga(t,:x.t)dW{t), (1.2) 

where F = [/i, / 2 ,..., /„] is an R^^^-valued function and G = [7^, 0,..., O] ^ stands for an 
{nd X d) matrix that embeds into M"'^. 

Let 12 be a regular bounded open domain in R"'^, with smooth boundary L. For an open sub- 
domain U of 12, we consider the following distributed control system, governed by a partial 
differential equation (PDF) of parabolic type, with a control distributed over U, i.e., 

dv 

= uxu in {0,T)xn 
ot 

y(0, x) = 0 on 12 

y{t,x)=0 for (/,x) G E = (0,r) X F 

where u{t, x) G L^((0, T) x /7) is a control function, xu is a characteristic function of the 
subdomain U and £* x is a second-order operator given b}0 
1 _ 

A,X = -tr{a{t,x)Dli) -f/i(/,x)72^i + V /j(f,x^"i)72^,, (1.4) 

Z 3—^ 



‘x^-i = fi-^,...,x^)iorj = 2,...n. 
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witha(i,x) = cr(i, x)cr^(t, x). 

Remark 2. Note that, in in). the random perturbation enters in the first subsystem through 
the diffusive part and is then subsequently transmitted to other subsystems. As a result, such a 
distributed system is described by an W^‘^-valued diffusion process, which is degenerate in the 
sense that the second-order operator associated with it is a degenerate parabolic equation. 
Moreover, we also assume that the distributed system in O' satisfies a weak Hdrmander 
condition (e.g., see SSI or m Section 3] for additional discussions). 

In what follows, we assume that the following statements hold true for the distributed system 
in ( |l.l| i. 

Assumption 1. 

(a) The functions /i(<,x) and for j = 2, ...,n are bounded C'°°((0,(X)) x 

and (^“((OjOo) x W''^~^^^'^'^)-functions, respectively, with bounded first deriva¬ 
tives. Moreover, and are bounded C'“((0,(X)) x -functions, with 

bounded first derivatives. 

(b) The second-order operator in ( |1.4| l is hypoelliptic in C°°((0, oo) x (e.g., see 
l^orfSfS). 

Remark 3. In general, the hypoellipticity assumption is related to a strong accessibility 
property of controllable nonlinear systems that are driven by white noise (e.g., see con¬ 
cerning the controllability of nonlinear systems, which is closely related to and m; 
see also m Section 3]). From Part (b) of the above assumption, the Jacobian matrices 
x) and D^j-i fj{t, x-^”^) for j = 2,..., n are assumed to be nondegenerate uni¬ 
formly in time and space (i.e., they satisfy Holder conditions both with respect to time and 
second variables). 

Here it is worth mentioning that some studies on the controllability of systems that are gov¬ 
erned by parabolic equations have been reported in literature (e.g., see ifT^ in the context of 
Stackelberg optimization; and m and in the context of Stackelberg-Nash controllability- 
type problem)]^ Note that rationale behind our framework follows in some sense the settings 
of these papers. However, to our knowledge, the problem of optimal control for a chain 
of distributed system governed by degenerate parabolic equations has not been addressed in 
the context of hierarchical argument, and it is important because it provides a mathematical 
framework that shows how a hierarchical optimization framework can be systematically used 
to obtain optimal strategies for the leader and that of tht follower (distributed over an open 
subdomain) for a chain of distributed system with random perturbations]^ 

The remainder of this paper is organized as follows. In Section]^ using the remarks made 
above in Section [T] we state the optimal control problem for a chain of distributed system. 
Section [^presents our main results - where we introduce a hierarchical optimization frame¬ 
work under which the follower is required to respond optimally, in the sense of best-response 
correspondence to the strategy of the leader (and vice-versa) so as to achieve the overall 
objectives. This section also contains results on the controllability-type problem for such a 
distributed system. For the sake of readability, all proofs are presented in Section Finally, 
Section [^provides further remarks. 

^Recently, the authors in (3) and have also provided some results, but in different contexts, pertaining to a 
chain of distributed systems with random peifurbations. 

^In this paper, our intent is to provide a theoretical framework, rather than considering a specific numerical 
problem or application. 
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2. Problem Formulation. In this paper, we consider two objectives that we would like 
to accomplish. The hrst one being of a controllability type that consists of guaranteeing the 
terminal state to reach a target set from an initial condition; while the second one is keeping 
the state trajectory of the overall system close to a given reference trajectory on a hnite, 
compact time intervals. Such a problem can be stated as follow: 

Problem: Find an optimal control strategy G T^((0, T) x U) (which is distributed 

over U) such that 

(i) The first objective: Suppose that we are given a target point ?/*» in (17). 

Then, we would like to have 

y{T]u)Gy^o+aB, a > 0, (2.1) 

where y{t; u*) denotes the function x i—)■ y{t, x; u*), B is a unit ball in LF’ifil) and a 
is an arbitrary small positive number]^ 

(ii) The second objective: Suppose that we are given a reference trajectory y^’f it, x) in 
L2((0, T) X 17). 

Then, we would like to have the state trajectory y{t, x; u*) not too far from the refer¬ 
ence y^f (7, x) for all t G (0, T). 

In order to make the above problem more precise, we specihcally consider the following 
hierarchical cost functionals: 

JiM = ^ [ I u^dxdt 

J (O.T)xC/ 

s.t. y{T-,u) G y*’’+ aB, a > 0 (2.2) 

and 

J2{u) = l[[ - y''f {t,yL)f dyidt 

J (o,T)xn 

+ ^ [ [ u^dxdt, P > 0. (2.3) 

J iO,T)xU 

Note that, in general, hnding such an optimal strategy u* G L^{{0, T) x U) that minimizes 
simultaneously the above cost functionals in ( |2.2| l and ( |2.3| l is not an easy problem. How¬ 
ever, in what follows, we introduce the notion of Stackelberg’s optimization ll20l (which is a 
hierarchical optimization framework), where we specihcally partition the control subdomain 
U into two open subdomains Ui and U 2 (with Ui D U 2 = 0) that are compatible with the 
strategy subspaces of the leader and that of the follower, respectively. That is, 

(7 = f/i U t /2 up to a set of measurable U, (2.4) 

where the strategy for the leader (i.e., ui) is from the subspace Lf{{Q,T) x Ui) and the 
strategy for the follower (i.e., U 2 ) is from the subspace T^((0, T) x 1 / 2 )- 


^Note that the condition on the terminal state in j2.11 is associated with a controllability-type problem with 
respect to an initial condition y(0, x) = 0 on (e.g., see 1131 for additional discussions). 
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Note that if xUi, for i = 1,2, denotes the characteristic function for Ui and Ui is the restriction 
of the distributed control u to i^((0, T) x Ui). Then, the PDE in ( |1.3[ ) can be rewritten 
as 

dy 

+ A,x 2/ = MiXc/i + U2XU2 in (0, T)xQ. 

2 /( 0 , x) = 0 on 
y(t,x) = 0 for (f,x) e S 

where y(t,x;u) = y{t,x-{ui,U2)), with {ui,U2) G T) x Ui) x i^((0, T) x 

U2). 

Suppose that the strategy for the leader ui G U^(( 0 , T) x Ui) is given. Then, the problem 
of finding an optmal strategy for ihs follower, i.e., U2 G T) x U2), which minimizes 

the cost functional J 2 is then reduced to finding an optimal solution for 



such that 


inf 

U2eL^i(0,T)xU2) 


J2{ui,U2) 


( 2 . 6 ) 


U 2 = (2.7) 

for some unique map TZ \ T^((0, T) x Ui) -G T) x C/ 2 ). Note that if we substitute 

U 2 = 7^(ui) into ( |2.5[ ), then the solution y{t,x; {ui,TZ{ui))) depends uniformly on ui G 

L^((0, T) X C/i). Moreover, the controllability-type problem in ( |2.2| i is then reduced to 
finding an optimal solution for 

inf Ji(ui) 

uieL^((0,T)xl7i) 

s.t. y(T; (ui,7Z(ui))) G y^‘’+ aB. (2.8) 


In the following section, we provide a hierarchical optimization framework for solving the 
above problems (i.e., the optimization problems in ( |2.61 l, together with ( |2.7[ ) and ( |2.81 l). Note 
that, for a given ui G B^((0, T) x Ui), the optimization problem in ( |2.6| l has a unique 
solution on T^((0, T) x C/ 2 ) (cf. Proposition |3.l| l. Moreover, the optimization problem in 
p.8| l makes sense if y{T; {ui,TZ{ui))) spa ns a de nse s ubset of Lf{Vl), when ui spans the 
subspace T^((0, T) x Ui) (cf Propositions |3.2| and 3.3 1 . 


3. Main Results. In this section, we present our main results - where we introduce a 
framework under which the follower is required to respond optimally, in the sense of best- 
response correspondence to the strategy of the leader (and vice-versa) so as to achieve the 
overall objectives. Moreover, such a framework allows us to provide a new result on the exis¬ 
tence of optimal strategies for such optimization problems pertaining to a chain of distributed 
system with random perturbations. 


3.1. On the optimality distributed system for the follower. Suppose that, for a given 
leader strategy ui G T^((0, T) x C/i), if U 2 G T) x C/ 2 ), i.e., the strategy for the 

follower, is an optimal solution to ( |2.6| ) (cf. ( |2.3| )). Then, such a solution is characterized by 
the following optimality condition 

(^y — y^f)ydxdt(3 / U 2 U 2 dxdt = 0, 

(0,T)xO J J { 0 ,T)xU 2 

Vu 2 G L2((0, T) X C/ 2 ), 



(3.1) 
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where y and y are, respectively, the solutions to the following PDEs 


and 


= MiXUi + U 2 XU 2 in (0, T) X n 
y(0, x) = 0 on 
j/(f, x) = 0 for (f,x) e S 


= u*2XU2 in (0, T) X f] 
y(0, x) = 0 on Q. 
y(f,x) = 0 for (f,x) G E 


Furthermore, if we introduce an adjoint state p as follow 

dj) 

--£ + ^,^p = y-y''^ in (o,r)xff 

p{T, x) = 0 on fl 
p(f,x) = 0 for (f,x)GS 


(3.2) 


(3.3) 


(3.4) 


where ^ is the adjoint operator for £(_x. Then, we have the following result which charac¬ 
terizes the map TZ in p.7| i (i.e., the optimality distributed system for the follower). 

Proposition 3.1. Letui G L^{{0, T)xUi) be given. Suppose that the following PDE 

dy 1 

+ £uxy = uiXUi - -XPXU 2 , in (0, T)xn 

dj) 

= y- y'^^ in {0,T)xfl I 

y{0, x) = 0 on fl 
p(T, x) = 0 on n 
?/(f,x) =p(f,x) = 0 for (f,x)GE 


admits a unique solution pair {y{ui),p{ui)') (which also depends uniformly on Ui G Lf{{0, Tjx 
Ui)). Then, the optimality distributed system for the follower is given by 


7^(■Ul) = 


1 


P{ui)xu2 


= u 


* 

2 - 


(3.6) 


Remark 4. The above proposition states that if the strategy of the leader ui G £^((0, T) x 
Ui) is given. Then, the strategy for the follower U 2 = TZ(ui), which is responsible for keep¬ 
ing the state trajectory y{t, x; (ui, TZ(ui))) close to the given reference trajectory y^f (t, x) 
on the time intervals (0, T), is optimal in the sense of best-response correspondence. Later, in 
Proposition |3.2) we provide an additional optimality condition on the strategy of the leader, 
when such a correspondence is interpreted in the context of hierarchical optimization frame¬ 
work. 

3.2. On the optimality distributed system for the leader. In this subsection, we pro¬ 
vide an optimality condition on the strategy of the leader in ( |2.2| l, when the strategy for the 
follower satisfies the optimality condition of Proposition |3.l| 
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For a given ^ S L‘^{Vl), let ip and d be unique solutions to the following PDF 

“ (0,T)xf^ 

dv 1 

^=-^<PXc/2 in (0,T)xf] 

at p V . 

t9(0, x) = 0 on n 

p(T, x) = ^ on n 

p{t,:x.) ='d{t,x) = 0 for (f,x)eE 

Next, define the following linear decompositions 

y = yo + z and p = pQ + q 


(3.7) 


(3.8) 


such that yo and po are the unique solutions to the following PDF 

^ + A,x2/o = - ^PoXU 2 in (0,T) x n 

-^ + ^?,xPo = yo- in (0, T) X n ^ ^ 

2/0 (0, x) = 0 on fl 
Po(7", x)=0 on n 
yo{t,x)=po{t,x) = 0 for (f,x)eE 

Note that, from ( |3.5| ) and ( |3.9| l together with ( |3.8[ ), it is easy to show that z and q are the 
unique solutions to the following PDF 


Oz 1 

— + Ct,^z = ulxui - -^qXU 2 in (0, T) x ^ 

-^^+Cl^q = z in (0,T)xF! 

2 ;( 0 ,x) = 0 on n 
q(T, x) = 0 on Vt 
z\t,x) = q{t,x.) = 0 for (f,x) G E 


(3.10) 


where u\ G F^((0, T) x Ui) is an optimal strategy for the leader which satisfies additional 
conditions (see below ( |3.121 l and ( |3.131 l). 

In what follows, let us denote the norm in L?{Vl) by || • and assume that ^ G 

satishes the following 

(z(T), ^)=0, Vtti G l2((o, T) X C/i), (3.11) 

where (•, .) denotes the scalar product in Lp{yi). 

Then, we have the following result which characterizes the optimality condition for the leader 
in ( |2.2| l. 

Proposition 3.2. The optimal strategy for the leader that minimizes 


inf Ji(ui) 

iiiGL2((0.T)x(7i) 

s.t. y{T;{ui,TZ{ui))) G y*” + aB 


is given by 


u*i = viOxu^, 


(3.12) 
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where ip{^) is given from the unique solution set {y{^),p{^), '*^(^)} fa'' optimality 

distributed system 


^ = ulxui - ^PXU2 in (0, T) xn 

dp 

--^+£l^p = y-y^f in {0,T) x n 

io,T)xn 

dP 1 • 

= -j^PXU2 in (0, T) xn 

2/(0, x) ='(9(0, x) = 0 on XI 
p{T, x) = 0 on Xl 
p{T, x) = ^ on XI 

2 /(i,x) =p(9,x) = (^(i,x) ='(9(i,x) = 0 for (t,x) € E , 


(3.13) 


Moreover, ^ G L'^{Xl) is a unique solution to the following variational inequalit;^ 


{y{fa 0 - I - 0 + «(llllU=(n) - Ulfam) > 0, v| e faixi). 


(3.14) 


Remark 5 . Note that the hierarchical optimization problem in Proposition |3.2| requires 
the follower to respond optimally to the strategy of the leader in the sense of best-response 
correspondence, where such a correspondence is implicitly embedded in p.l3| l (see also 
Section^for additional remarks). 


3.3. On the controllability-type problem for the distributed system. In the follow¬ 
ing, we consider the controllability-type problem in ( |2.81 l, where we provide a condition 
under which y{T-, {ui,TZ{ui))) spans a dense subset of Lf{Xl), when ui spans the subspace 
L2((0, T) X Ui). 


Proposition 3.3. Suppose that Proposition 3.2 holds true. Then, for every y^^ G Lf{Xl) 


and a > 0 (which is arbitrary small), there exits Ui G E^((0, T) x Ui) such that 


y(T; {ui,TZ{ui))) G y*‘> -f aB. 


(3.15) 


Remark 6. Note that the above proposition implicitly requires the strong accessibility prop¬ 
erty of the distributed system in which is concerned with the controllability property of 
nonlinear systems with random perturbations (see Assumption^and Remark^. 

Remark 7. Following the same discussion as above (i.e.. Subsections |5.7| and [!0] ), we 
can also consider a family of hierarchical cost functionals Ji(mi), J 2 {u 2 ), ■ ■ ■, with 

N > 3, and a family of control strategies distributed over open subdomains Ui C Xl, 

where U = with Ui OUj = 0 for i j. Moreover, if ujq follows u^-i ,..., wi; 

and um-i leads un and, at the same time, it follows utv- 2 , • ■ ■, Ui, etc. Then, for a given 
Ml G T) X Ui), such a whole hierarchical optimization problem could be solved if 

there exist some maps TZj : T) x Uj) -G Lf((Q, T) x Uj+i) (that also depend on the 

cost functionals) such that u*j^i = TZj{uj) for j = 1,..., N — 1 (e.g., see Hll\ Section 31 for 
further discussions on one-leader and many-followers). 

^Note that, in 13.141 , we write y(T\ §) to make explicitly the fact that the solution set {j/(C), p(?), t^(?)} 

of 13.131 depends uniformly on^ £ L^(0). 
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4. Proof of the Main Results. In this section, we give the proofs of our results. 


4.1. Proof of Proposition |3.l[ For a given ui G L^{{0, T) x Ui), let y and p be the 
unique solutions of ( |3.5| ). If we multiply the second equation in ( |3.5| l by y and integrate by 
parts. Further, noting the PDFs in ( |3.3| ) and ( |3.4| i, then we have the following 

[ [ {y-y'~f)ydy:dt= [ [ (-^+C*t p']ydKdt 

J J (o.T)xa J J (o,r)xn\ ot j 


P 


(o,r)xn 


dy 

dt 


+ Ct,^y I dxdt 




pu^d'Kdt. 


(4.1) 


(4.2) 


(0,T)xC/2 

Moreover, using the optimality condition in ( |3.1| l together with ( |4.1| ), we obtain 

PXU2 + = 0, 

which further gives an optimal strategy for t\\& follower as 

* 1 

^2 = -pPXU2 

= TZ{ui), 

where p is from the unique solution set {p{ui),y{ui)} of ( |3.5 1 tha t depends uniformly on 
ui G F^((0, T) X Ui). This completes the proof of Proposition 


3.1 


□ 


4.2. Proof of Proposition |3.2[ Note that the optimization problem for the leader in (|Z 
is equivalent to 

o / / u\dyidt 

J (0,T)xC/i 

s.t. y{T-,{ui,n{ui))) Gy*o-yo{T)+aB (see (|T8ll). 


Introduce the following cost functionals 

'h{ui) = ^ 


(0, r)x;7i 


Uidxdt 


and 


J2iui) = 


0 if ^ G y*!’- yo{T) + aB 
+00 otherwise on L^(f2) 


Let % G .jSf (L^((0, T) X Ui); be a bounded linear operator such thaj^ 

Tiui = z(T; Ml). 

Then, the optimization problem in \2.2\ is equivalent to 


inf 

«iGL+(0.T)xC/i) 


+ J2{ui) 


(4.3) 


(4.4) 


(4.5) 


(4.6) 


T) x Ui); L^{Q)) denotes a family of bounded linear operators. 
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Furthermore, using Fenchel duality theorem (e.g., see M or 0), we have the follow¬ 
ing 


inf hiiui) + J 2 {ui)} = - inf + (4.7) 

where H* is the adjoint operator of H and the conjugate functions J* are given by 

= sup{(v5,(^) - i = l,2. (4.8) 

v> 

Note that if we multiply the hrst equation (respectively, the second one) in ( |3.13| l by z (re¬ 
spectively, by q) and integrate by parts, then we obtain the following 


{z{T),0 


{0,T)xUi 


ipu*dxdt. 


Then, for ^ S that satishes (|3.11|), we have the following 


n*^ = ^xu„ 

where (p is from the unique solutions of p.l3[ l. 

Note that 

jr«) = Ji«) 


(4.9) 


(4.10) 


(4.11) 


and 


4(C) = (C, - 2/o(T)) + allCllL^(O). (4.12) 

Then, the optimization problem in p.2| l is equivalent to 

inf / f ip^dxdt + a||C||L 2 (n) - (C, 2/*® - yo{T)) 

S J {0,T)xUi 

s.t. y{T;{ui,TZ{ui))) e - yo{T) + aB. (4.13) 

Let ^ S (fl) be a unique solution to the following variational inequality 


(0,T)x(7i 


(p{(p - (p)dxdt + {y{T-,^) - C- C)+a(IICIlL2(n) - IICIlL^cn)) > 0, 


ViGL^in). (4.14) 


Moreover, if we multiply the hrst equation (respectively, the second one) in ( |3.7| ) by {p — p) 
(respectively, by (d — i9)) and integrate by parts, we obtain the following 


(O.T)xC/i 


p(p - p)dxdt = {z{T), C - /) • 


(4.15) 


Thus, if we substitute ( |4.15| l into ( |4.14[ ), then we obtain ( |3.14[ ). This completes the proof of 
Proposition |3.2| □ 
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4.3. Proof of Propositioii |3.3[ From Propositi on |3.2[ suppose that the PDF in ( |3.131 l ad¬ 
mits unique solutions (i.e., y{t, x; ^), p{t, x; ^), (p{t, x; and x; for {t, x) € (0, T) x 
n that depend uniformly on ^ S Then, noting ( |3.11| ), the condition in ( |4.9| l be¬ 

comes 


(p{t,ic) = 0 for (f, x) S (0, T) X Ui, (4.16) 

which implies the following conditions (see also ( |3.71 i) 

'^XUi = 0 , 

d'S 

— + = 0 in (0, T)x{u\ C/ 2 ) 


and 


-^+Cl^p = 0 in (0,T)x (C/\C/ 2 ). 

Furthermore, using Mizohata’s uniqueness theorem (e.g., see US) together with the reg¬ 
ularity conditions on /i(f,x®“^) and a(f,x) (see also Assumption [^, then we obtain the 
following 


dit, x) = 0 for {t, x) e (0, T) X (C7 \ U 2 ) , (4.17) 

which requires ^ to have a zero value outside of U 2 (cf ( |4.10| i and ( |3.11| l). 

Next, consider the restriction of ip and d to (0, T) x U 2 such that 

-^+Cl^p = ^ in {0,T)xU2 
dP 1 

-^+Ct,.^ = -^ipXU2 in (0 ,T)xC/2 I 

dip d'& 

^ = 0 , for (f,x) e (o,r) X ac /2 

V’iT,:x.) = ^XUi, -i/(0,x) = 0 on U 2 

Then, from ( |4.18| l, it remains to show that ^XU 2 = 0’ which is a sufficient condition for 
y(T; {ui,TZ{ui))) to span a dense subset of L^(f2), when ui spans the subspace T^((0, T) x 
U,). 

Note that the first two equations in ( |4.18| l imply the following 

(^-^ + /::,x)<F+^<P = 0, on (0,r)xC/2. (4.19) 

which is a quasi-elliptic equation; and in view of Cauchy problems on bounded domains (e.g., 
see lITSl Theorem 6.6.1]), for any fixed t G (0, T), (p(t, x) is analytic in C/ 2 , with Cauchy data 
zero on 9 C/ 2 . As a result of this, (p(t, x) = 0 on (0, T) x 9 C /2 and also continuous in t, then 
we have (/3(0,x) = 0 and </?(/, x) = ■(?(/, x) = 0 for (/,x) G (0,T) x 9 C/ 2 , which implies 
^XU 2 = 0 (cf. ( |4.18] l, since ip{T,x) = ^XUi)- This completes the proof of Proposition [3^ 
□ 
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5. Further remarks. In this section, we briefly comment on the implication of our 
result in assessing the influence of the reachable target set on the strategy of the follower in 
relation to the direction of leader-follower md follower-leader information flows. 

Note that the statement in Proposition |3.1| (i.e., the optimality distributed system for fol¬ 
lower) is implicitly accounted in Proposition |3.2| (cf. ( |3.13| )). Hence, the optimal strategy for 
t\\& follower (cf. p.6[ l) is given by 

U2 = -^PiOXU2 
= 

where ^ G Lf{Vl) is a minimum solution to the variational inequality in p.l4| ) and it also 
assumes a zero value outside of U 2 (i.e., ■fxc /2 = 0)- Moreover, such a minimum solution lies 
in a certain dense subset of LfiVl), which is spanned by y{T\ {ui,TZ{ui))), when ui spans 
L^((0,T)xt/,)(cf.PropositionQ. 

Note that, from Proposition |3.2| (cf. ( |4.10| l), we also observe that the optimal strategy for the 
leader is given by 


K = p{C}Xu^, 

which is implicitly conditioned by the target set + aB, where a is an arbitrary small 
positive number (cf ( |Z2l l or (1^). Moreover, the terminal state is guaranteed to reach 
the target set starting from an initial condition 2/(0, x) = 0 on H (i.e., y{T\ G 

2/*3 + aB)-, and the state trajectory y{t,x; (u^,7?.(u*))) is not too far from the reference 
2 /’'^(f, x) for all t G (0,T). As a result of this, such interactions constitute a constrained 
information flow between the leader and that of Iht follower (i.e., an information flow from 
leader-to-follower and vice-versa) that captures implicitly the influence of the reachable target 
set on the strategy of the follower. 
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